arXiv:1505.07158v2 [cs.SY] 16 Mar 2016 


1 


Resilient and Decentralized Control of Multi-level Cooperative Mobile 
Networks to Maintain Connectivity under Adversarial Environment 

Juntao Chen and Quanyan Zhu 

Department of Electrical and Computer Engineering, Tandon School of Engineering 
New York University, Brooklyn, 11201, USA. E-mail: {jc6412, qz494}@nyu.edu. 


Abstract — Network connectivity plays an important role in the 
information exchange between different agents in the multi-level 
networks. In this paper, we establish a game-theoretic framework 
to capture the uncoordinated nature of the decision-making at 
different layers of the multi-level networks. Specifically, we design 
a decentralized algorithm that aims to maximize the algebraic 
connectivity of the global network Iteratively. In addition, we 
show that the designed algorithm converges to a Nash equilibrium 
asymptotically and yields an equilibrium network. To study 
the network resiliency, we introduce three adversarial attack 
models and characterize their worst-case impacts on the network 
performance. Case studies based on a two-layer mobile robotic 
network are used to corroborate the effectiveness and resiliency 
of the proposed algorithm and show the Interdependency between 
different layers of the network during the recovery processes. 

I. Introduction 

Teams of mobile cooperative robots have a wide range 
of applications, such as rescue, monitoring, and searching in 
space exploration. One of the challenges in this kind of mobile 
robotic network (MRN) is to maintain the connectivity be¬ 
tween robots, since a higher connectivity enables faster infor¬ 
mation spreading and hence a high level of situational aware¬ 
ness. Connectivity control of the MRN has been addressed in 
a number of previous works including iSlEi which have 
successfully tackled a single network of cooperative robots. 
Recent advances in networked systems have witnessed emerg¬ 
ing applications involving multi-layer networks or network-of- 
networks Hi . For example, when unmanned aerial vehicles 
(UAVs) and unmanned ground vehicles (UGVs) execute tasks 
together, the whole network can be seen as a two-layer 
interdependent network as shown in Fig. [T] Another example 
is the complex networks including mobile vehicular network 
and communication networks in public infrastructures. The 
interaction between mobile vehicles needs the support from 
communication network thus making two networks coupled. 
Therefore, the current single network control paradigm is not 
sufficient yet to address new challenges related to the analysis 
and design of multi-layer mobile networks. 

The main objective of this work is to develop a theoretic 
framework that can capture the interactions between robots 
within a network and across networks. In our problem setting, 
each layer of the robotic network aims to maximize the 
connectivity of the overall network. If the whole network 
is fully cooperative or governed by a single agent, then the 
designed network is a team-optimal solution. However, in 
practice, different layers of robotic networks are often operated 
by different entities, which makes the coordination between 
separate entities difficult. For example, in the previous UAV 



Fig. 1. Two-layer mobile robotic networks. One network consists of 5 UAVs, 
and the other network consists of 6 UGVs. 

and UGV two-layer networks in Fig. 1, though the objectives 
for two networks are aligned, UAV is operated by the air 
force while UGV is operated by the army, which could lead to 
insufficient coordination. To address this problem, we establish 
a game-theoretic model in which two players control robots to 
maximize the global connectivity independently. This frame¬ 
work captures the lack of coordination between players in the 
multi-level networks. Furthermore, it guides the algorithmic 
design of decentralized mechanism for achieving an equilib¬ 
rium solution that is close to the team-optimal solution. In 
this paper, two players update their own robotic configuration 
based on the current one to maximize the network connectivity. 
This generates an iterative algorithm which converges to a 
Nash equilibrium (NE) point asymptotically and yields an 
equilibrium MRN. 

An MRN is prone to adversarial attacks since a robot can 
be controlled by an adversary @ |3l, and the communication 
links between robots can be jammed |@, [l^]- Therefore, re¬ 

silient control of the multi-level robotic networks to malicious 
attacks is critical to enhance its resiliency. To this end, we 
model the mobility of the robots by taking into account the 
communication links within and across the networks and use 
a game-theoretic approach to develop a resilient and decen¬ 
tralized algorithm for the individual networks. To study the 
network resiliency, we consider three attack models including 
the global positioning system (GPS) spoofing attack, targeted 
jamming attack and denial-of-service (DoS) attack. The impact 
of each attack can be quantified by measuring the difference of 
the algebraic connectivity of the network under a certain type 
of attack and without attacks. In addition, we characterize the 
worst-case of each attack and identify the interdependencies 
that exist in the multi-level networks. Case studies show that 
the robot removal resulting from the DoS attack will lead to 
the largest decrease in the network connectivity, and the MRN 
is the most resilient to the GPS spoofing attack which results 
in the constrained physical movement of robots by using the 
proposed control method. Furthermore, robots in the network 
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without attacks will respond by moving to the positions that 
can set up the most communication links with the robots in 
the attacked network during the recovery processes, and this 
shows the interdependency in the multi-level networks. 

The contributions of this paper are summarized as follows; 

1) We establish a game-theoretic framework that enables a 
decentralized control of mobile robots in the multi-level 
networks. 

2) We introduce three attack models to the network and 
characterize their worst-case scenarios. In addition, we 
design a resilient and decentralized algorithm that aims to 
maximize the algebraic connectivity of the global MRN. 

3) We show the convergence of the designed algorithm to a 
NE asymptotically, and corroborate its effectiveness and 
resiliency by case studies. The existence of interdepen¬ 
dency in the multi-level MRN is also verified. 


A. Related Work 

In the previous works, robotic network connectivity control 
OToblem is often addressed either in a totally centralized way 
121, or completely decentralized way SElHi. 


proDlem i 

EiE 


The centralized framework yields an optimal network but with 
low resiliency, since responses to failures in a global network 
may not be instantaneous. The network resulting from the 
decentralized framework is resilient; however, it is difficult 
to achieve the team solution with limited coordination. Our 
framework stands in between these two frameworks and thus 
leads to balanced features in terms of resiliency and optimality. 


B. Organization of the Paper 

The rest of the paper is organized as follows; Section [H] 
presents some basics of graph theory and interdependent 
networks. We formulate a multi-level network formation game 
problem in Section |In] System dynamics discretization and 
the equilibrium solution concept is presented in Section |IV] A 
semidefinite programming approach and an iterative algorithm 
are proposed in Section |V] Section |VT] introduces three types 
of attacks to the MRN and characterizes their corresponding 
worst-case conditions. Case studies are given in Section Ivnl 
and Section rVlIIl concludes the paper. 

II. Background and Interdependent 
Network Model 

Let G{V,E) be an undirected graph composed by a set 
V of n nodes and a set E of m links with n = \V\, and 
m = \E\. For a link e G E connecting nodes i and j where 
the link weight is equal to Wij, we define two vectors Se G ffi." 
and be G R", where ae(i) = 1, ae(j) = — 1, be(*) = Wy, 
be(j) = —Wij, and other entries 0. Then, the Laplacian matrix 
L of network G can be expressed as 

m 

L^gaebf. (1) 

e=l 

Basically, for the weighted Laplacian matrix L, its diagonal 
entries are equal to La = ^ where Ni 

denotes the set of nodes that are connected to node i. In 


addition, = —Wij if nodes i and j are connected, for 
i j G V, and 0 otherwise. Note that Wij = Wji, 'ii,j G V. 
By ordering the eigenvalues of L in an increase way, we obtain 


0 — Ai < A 2 < ... < A„, (2) 


where A 2 (L) is called algebraic connectivity of G. In addition, 
the Fiedler vector of a network refers to the eigenvector 
associated with the eigenvalue A 2 (L) Q. 

For a two-layer interdependent network, we define two 
networks G'i(Vi,£'i) and G 2 {V 2 , E 2 ), where network 1 and 
network 2 are represented by Gi, for i = 1,2, respectively. 
Network i, i G {1,2}, is composed of rii = \Vi\ nodes 
and rrii = \Ei\ links. The global network resulting from 
the connection of these two networks can be represented by 
G = (Vi U V 2 ; El L) E 2 L) E 12 ), where E 12 is a set of 
intra-links between Gi and G 2 . For convenience, we denote 
the network consisting of the intra-links between Gi and G 2 
as Gi 2 . The adjacency matrix A of the global network G has 
the entry 


Oij 


Wij , nodes i and j are connected; 

0, nodes i and j are not connected. 


Let Ai G and A 2 G R" 2 xn 2 adjacency matrices 

of Gi and G 2 , respectively, and n = ni -\-n 2 - When E 12 ^ 0, 
the adjacency matrix A G takes the following form 


A = 



Bi2 

A 2 


where B 12 G is a matrix used to capture the effect 

of intra-links between networks. Define two diagonal matrices 
Di G and D 2 G R” 2 xra 2 as 

(Di),, = ^ (Bi 2)^„ (D2).i = ^ 
j j 


Then, by using L = D — A, we obtain the Laplacian matrix 


Li -f Di ~Bi2 
L2 -f D2 


(3) 


where Li and L 2 are the Laplacians corresponding to Ai and 
A 2 , respectively. 

Remark 1: The above formulated two-layer interdependent 
framework can be easily extended to multi-layer cases. 


III. Problem Formulation 

In this section, we formulate a two-Ievel mobile robotic 
network formation problem using a game-theoretic framework. 


A. Two-level Network Formation Game 

The position of robots in the network is denoted by a vector 
x(t) = X2 { t ), ..., Xn { t )) G and the dynamic of 

each robot i is given by Xi { t ) = Ui { t ), where Ui { t ) G R.^ is 
the control of robot i at time t . Besides, robots in the network 
can exchange data via wireless communications. Denote the 
communication link between robots i and j as { i , j ). Then, the 
strength of the communication link { i , j ) can be captured by 
the weight of the link. Thus, we can assign a weight function 
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w : X —>■ IR+ to each communication link such 

that 

= w{x^{t),Xj{t)) =5(11 x^j{t) II 2 ), 

for some g : K+ ^ R+, where Xij{t) := Xi{t) — Xj{t). The 
strength of a communication link decays exponentially with 
the distance S. Therefore, the entries A^j of the adjacency 
matrix A admit 

1, \\ Xij { t ) \\ 2 < Pl \ 

-Q(||!r^j(t)||2-Pi) 

e P2-P1 , Pi <\\ Xij { t ) \\ 2 < P 2 \ 

0, \\ Xij { t ) \\ 2 > P 2 , 

for pi,p2 G R+, and pi < p2- When the distance between the 
robots is less than pi, the connectivity strength is up to 1; and 
when the distance is larger than p2, robots lose the connection. 

The model of a two-layer MRN is similar to the one in Fig. 
[U Robots in the upper layer belong to network Gi, and robots 
in the bottom layer belong to network G'2. For convenience, 
we label robots in Gi as 1 , 2 , ...,ni € Vi, and robots in G2 
as ni + l,ni + 2 , ...,ni + n2 € V2. In addition, robots in 
the same layer and various layers can communicate with each 
other, and these communication links are called inter-links and 
intra-links, respectively. Note that exchanging data between 
robots in different layers is more difficult than that of the 
robots in the same layer due to much longer distance. Thus, 
to enable the information exchange between Gi and G2, we 
assume that the communication strength of intra-links has a 
larger value of pi and p2 comparing with that of inter-links. 

For simplicity, define —7 = { 1 , 2 } \ 7, where 7 £ { 1 , 2 }. 
We consider that two players, player 1 (Pi) and player 2 
(P2), play a network formation game. Pi controls robots 
in network Gi, and P2 controls robots in G2. Specifically, 
Pi and P2 update their own mobile network iteratively by 
controlling the robots’ positions which are denoted as Xi 
and X2, respectively. Note that Xi := (xi,..., G 
X2 := (Xni+i, ■■■,Xn) G and x := (xi,X2). For each 

update, P-f’s strategy is based on the current configuration 
of network G_.y. The objectives of players are aligned by 
maximizing the algebraic connectivity of the whole network 
G, A2(Lg'(x)), at every step. In addition, the action spaces 
of Pi and P2 are denoted by Xi and X2, respectively, which 
include all the possible network configurations. The set of pure 
strategy profiles X := Xi x X2 is the Cartesian product of the 
individual pure strategy sets. Besides, the utility function for 
both players is A2(Lg(x)); X —R+. 

Remark 2 : In general, the objectives of two players can 
be different rather than maximize the algebraic connectivity 
of the global network. However, in our problem setting, the 
two teams of robots execute tasks collaboratively, and thus 
they both aim to optimize the global network connectivity to 
improve communications. 

In the MRN formation game, one essential constraint is the 
minimum distance between the robots in the same layer. With¬ 
out this constraint, all robots in the same layer will converge 
to one point finally which is unreasonable in reality. Thus, we 
assign a minimum distance for robots in Gi and G2 denoted by 
di and <^2, respectively. Then, the network formation game can 


be represented by two individual interdependent optimization 
problems Q\ and Q\ as follows: 


Q\ ■■ 

max 

xi(t+ri) 

A2 (LG(x(f-f Tl))) 




S.t. 

\\Xijit-\-Tl)\\l > dl, 

Vi, j G Vi, 

( 5 ) 



-H 

II 

5 ^. 

Vj G V2. 


Ql ■■ 

max 

X2(i + T2) 

A2(LG(x(f -f r2))) 




S.t. 

\\Xij{t + T2)\\l > d2, 

Vi,jG V2, 

(6) 



Xj{t-£T2) = Xj{t), 

Vj€Vi, 



where Vi and V2 denote the sets of nodes in Gi and G2, 
respectively, and ri G R+ and T 2 G R+ are the time constants 
indicating the update frequency of the players. Note that ri and 
T2 can be different because of distinct sensing, detection, and 
response capabilities of two mobile networks. Furthermore, 
smaller ti and T2 indicate a higher resilience of the network to 
attacks, since a higher update frequency leads to faster system 
recovery. 

Remark 3 : Note that the network formation game is played 
repeatedly over time, and its structure is the same only with 
different initial conditions in terms of the robots’ position. In 
addition, at each stage of play, the game captured by Q\ and 
Q2 can be characterized as a constrained potential game due 
to the identical objective of two players jlTT . 

IV. System Dynamics Discretization and 
Equilibrium Solution Concept 

To address the MRN formation problem formulated in 
Section Hn] we first analyze the fundamental network algebraic 
connectivity maximization problem (ACMP). For a given 
network G with n nodes, its algebraic connectivity can be 
represented by 

A2(Lg(x)) = min z'^Lg(x)z ( 7 ) 

||z||2 = l.Z±l 

based on the Courant-Fischer theorem ifisll . where 1 is an n- 
dimensional vector with all-one entries. In addition, the func¬ 
tion A2 (Lg(x)) is concave in Lg(x). Therefore, the ACMP 
maxx A2 (Lg(x)) gives rise to convex optimization approaches 
to deal with our MRN control problem. For the unconstrained 
ACMP, we present the following theorem. 

Theorem 1 The network algebraic connectivity maxi¬ 

mization problem max^. X2{Lc{x)) is equivalent to the follow¬ 
ing: 

max a 

X, a 

1 r 

s.t. LG(x)ta-(I„ - II ), 

n 

where a G R, and In is an n-dimensional identity matrix. 

A. Discretization of the Dynamics 

For each update of the robotic network, it is essentially not 
continuous in time. Therefore, for simplicity, we discretize 
the formulated problems Q\ and Ql in the following. First, 
we deal with the minimum distance constraint. By denoting 
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'^hen differentiating ||a;ij(f)||| with 
respect to the time, we obtain ||2l 

2 {a;i(f) - Xj{t)}'^{xi{t) - Xj{t)} = Zij{t). ( 9 ) 


By using Euler’s first order method x{t) —>■ x{k), x{t) —>■ 
, where At is the sample time, we rewrite (| 9 ll as 

2 {xi{k + 1 ) - Xjik + l)}^{a:i(fc) - Xj{k)} 

= Zij(k + l)+2^ij(fc). 


Similarly, differentiating and discretizing weight Wij yield 


Wij{k + 1) = Wij{k) + 


dfiWxjjlU) 

d\\x,j \\2 


{xij{k + 1) 
k 


Xij{k)}. 

( 11 ) 


Hence, we can obtain a discrete Laplacian matrix LG(x(fc)) 
by using (fTTl l which is presented in Section IIV-BI 


C. Nash Equilibrium of the Game 

For the formulated discretized MRN formation game, a 
natural solution concept is Nash equilibrium (NE). Before 
presenting the formal definition of NE, we first analyze the 
impact of the players’ action on the network at each step. 
Specifically, after Pi takes his action at step k, Gi and 
012 are reconfigured, where G12 is the network between 
Gi and G2- We denote network Gi and 012 at stage k as 
Gi^k and Gi2,fe, respectively. For simplicity, we further define 
Gi2,k ■= Gi^k U Gi2,fc, which is a shorthand notation for 
the merged network. Then, network Gk can be expressed as 
Gfc = Gi2,fe UG2,fe. Similarly, after P2 updates network G2 at 
step k, the whole network Gk becomes Gk = G2i,fc U Gi^fe, 
where G2i,k '■= G2,k U Gi2,fe. Then, the formal definition 
of Nash equilibrium (NE) which depends on the position of 
robots is as follows. 


B. Problem Reformulation 

Based on ([8]l and (fTOl i. and for given initial position vectors 
X2(/c) and Xi(fc) for Pi and P2, respectively, we can reformu¬ 
late the problems Q\ and Q2 as follows: 

Qi : max ai{k -f 1) 

Xi(fe-l-l), ai(fc+l) 

s.t. Gc{k + 1) ^ ai(fc + 1) • {In -11^), 

n 

2{xi{k + 1) - Xj{k + l)}^{a::i(fc) - Xj{k)} (12) 
= Zijfk + 1) + Zij{k), 

\\xij{k+ l)\\l> di, \/i,j€Vi, 

Xj{k + 1) = Xj{k), Vj e V 2 , 

Q2 '■ max a2{k + 1) 

X2(fc-|-1), a2(fe-|-l) 

S.t. LG(fc + 1) ^ a2(A: + 1) • (/„ --11^), 

n 

2{xi{k + 1) - Xj{k + l)}'^{xi{k) - Xj{k)} (13) 

= Zij{k + 1 ) + Zij{k), 

\\xij{k + l)\\l>d 2 , yi,j&V 2 , 

Xj{k + 1) = Xj{k), Vj e Vi, 

where ai{k + 1) and 0:2+ 1) are the scalar objectives of 
Qi and Q2, respectively. 

In addition, we obtain the discrete Laplacian matrix L,G{k + 
1 ) by using (fTTT l. and its entries l^{k + 1) are 

lf^{k + 1) = 

' - Wij{k + 1), if i f j, {i,j) € EiU E 2 ; 

- Wij{k + 1), if i G El, j G E2, or j G Ei, i G E2; 

< X! Wis{k + 1)+ ^ Wig{k + 1), if i = jeVi; 

s^i,s£Vi 

Wis(fc + 1)+ Wiq{k + 1), if i = jGE2; 

< s^i,sGV 2 q^i,qGVi 

where Wij, V{i,j) G Gi U E2, represent the weight of 
interlinks inside Gi and G 2 , and Wij, V{i,j) G E12, denote 
the weight of intra-links connecting Gi and G2. 


Definition 1 (Nash Equilibrium). The Nash equilibrium solu¬ 
tion to the discretized multi-level robotic networks formation 
game is a strategy profile x*, where x* = (x^jX^) G X, that 
satisfy 

X2{LGd^l,X*2)) > X2{LGdXl,X*2)), 
X2{Lg,{xI,X*2)) > MI^G,{x*i,X2)), 

for Vxi G Xi and Vx2 G X2, where k denotes the time step, 
and X — (j;:i,JC2) is defined in Section I///-AI 

Note that at the NE point, no player can individually 
increase the global network connectivity by reconfiguring 
their robotic network, and the two-level MRN possesses an 
equilibrium configuration. 

V. Semidefinite Programming and Iterative 
Algorithm 

In this section, we first derive a semidefinite programming 
(SDP) approach to address the discretized optimization prob¬ 
lems Qi and Q2, and then design an iterative algorithm to 
find the NE solution to the formulated MRN formation game. 

A. Semidefinite Programming Formulation 

Notice that in Qi and Q2, the minimum distance constraints 
\\xij{k -f 1 )||| > di, Vi,j G El, and \\xij{k -f 1 )||| > 
d2, Vi,j G E2, are nonconvex. To address this issue, one 
method is to regard the distance \\Xij{k+l)\\l = Zy(fc-fl) as 
a new variable, and solve problems Q\ and Q\ with respect 
to unknowns Zij{k -f 1 ) and x(fc -f 1 ) jointly. In this way, 
Qi and Q2 become convex problems. However, due to the 
coupling between the robots position and the distance vectors, 
solving Qi and Q2 via merely adding new variables will 
yield inconsistency between the obtained solutions x{k -f 1) 
and Zij{k + 1 ), Vi,j G E. Therefore, further considerations 
are needed, and we first present the definition of Euclidean 
distance matrix as follows. 

Definition 2 (Euclidean Distance Matrix). Given the positions 
of a set of n points denoted by JV := {xi,..., a:„}, the 
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Euclidean distance matrix representing the points spacing is 
defined as 

D .— dij — W^i ^ill2' 

A critical property of the Euclidean distance matrix is 
summarized in the following theorem. 

Theorem 2 (1^). A matrix D = is an Eu¬ 

clidean distance matrix if and only if 

— CDC ^ 0, and da =0, i = 1, n, (14) 
where C := In — -11^■ 

Note that (fT4l t is a necessary and sufficient condition that 
ensures D an Euclidean distance matrix. In addition, the 
inequality and equality in (fT4l) are both convex. Therefore, 
Theorem | 2 ] provides an approach to avoid the inconsistency 
between the robots position and distance vectors when they 
are treated as independent variables. In specihc, denote Z = 
[Zijjij^v, C = I„ — ^11^, and we can further reformulate 
problems and as 

_^ 

Qi : max ai{k +1) 

xi(/c+l), Z(fe+1), ai(fc+l) 

s.t. L( 3 (fc + 1) ^ ai(fc + 1)C, 

2{xi{k + 1) — Xj{k + l)}^{xi(fc) — Xj{k)} 

= Zij{k + 1) + Zij(k), ^ 

Zij{k + l)>di, 

- CZ{k + 1)C ^ 0, Zu{k + 1) = 0, ieV, 

Xj{k 1) = Xj{k), Vj e E 2 , 

_^ 

Qn : max a 2 {k +1) 

X2(fe+1), Z(fc+1), a2(/c+l) 

S.t. LG(fc + 1) ^ a2(fc + 1)C, 

2{xi(k + 1) — Xj(k + l)}^{xi(fc) — Xj{k)} 

= Z,,{k + l) + Z,,{k), (16) 

Zij{k + l)>d2, Vz,jeE2, 

- CZ(fc + 1)C ^ 0, Z,i{k + 1) = 0, i€V, 

Xj{k + 1) = Xj{k), Vj e Vi. 

_ /g 

Hence, and Q 2 become convex and are semidehnite 
programming problems which can be solved efficiently. 


B. Iterative Algorithm 

After obtaining the SDP problems Qi and Q2, we aim 
to find the solution that results in an equilibrium network 
conhguration. In the network formation game. Pi controls 
robots in Gi and reconhgures the network by solving the 
optimization problem Qi to obtain a new position of each 
robot. P2 controls robots in network G2 in a similar way by 
solving Q2- Note that the players’ action at the current step can 
be seen as a best-response to the network at the previous step. 
Besides, the update frequency of each player in the discrete 
time measure is needed to be determined. Eor given ti and 
T2 in the continuous time space, we can obtain their update 
frequencies by normalizing them into integers denoted by si 


and S2, respectively. Then, Pi and P2 reconfigure their robots 

for every si and S2 time intervals which can also be interpreted 

as the frequency of solving Qi and Q2, respectively. Since 

both players maximize the global network connectivity at 

every update step, then one approach to find the equilibrium 
_^ 

solution is to address Qi and Q2 iteratively by two players 
until the yielding MRN possesses the same topology, i.e.. 
Pi and P2 cannot increase the network connectivity further 
through relocating their robots. 


C. Feasibility and Convergence 

_^ _/j. 

Before solving the problems Qi and Q2, we should hrst 
analyze their feasibility, and we have the following lemma. 


Lemma 1 . For a given initial multi-level MRN where the 
distance between robots satisfies the predefined minimum 
distance constraint, then the game problems Qi and Q2 are 
always feasible. 

_^ 

When Qi and Q2 are feasible at each update step, another 
essential property is the convergence of the proposed iterative 
algorithm. Without loss of generality, we assume that two 
players will not update at the same step which can be easily 
achieved by normalizing the update frequency and choosing 
the initial update step of two players appropriately. Then, the 
convergence result is summarized in Theorem [3 


Theorem 3 . The iterative algorithm converges to a Nash 
equilibrium point asymptotically. 


_^ ^ 

Proof: Eirst, remind that both Qi and Q2 maximize the 
algebraic connectivity of the global network, and thus the 
resulting ai{k-\-l), i G {1, 2}, is no less than the one obtained 
from the previous update step which yields a non-decreasing 
network connectivity sequence A2. In addition, for a network 
with n nodes, its algebraic connectivity is upper bounded 


by n — 1 J 21 |. Thus, based on the monotone convergence 
theorem 12211. we can conclude that the network connectivity 
sequence converges asymptotically. Denote the actions of two 
players that achieve the network connectivity limit as Xi and 
X2 at some step I, and then, we obtain A2(Lg,(xi,X2)) > 
A2(LGi(xi,X2)), A2 (Lg,(xi,X2)) > A2(Lg,( xi,X2)), for 
Vxi G Xi and Vx2 G X2. Otherwise, Xi and X2 do not 
result in the network connectivity limit. Obviously, the strategy 
pair (xi,X2) satishes the NE Dehnition [ 1 ] which indicates 
that the proposed iterative algorithm converges to a NE point 
asymptotically. ■ 

Remark 4 : A typical example of the iterative algorithm is 
called alternating update in which Pi and P2 have the same 
update frequency and reconhgure the MRN sequentially. 


VI. Adversarial Attacks in the Networks 
Robots in the mobile networks are prone to malicious 


attacks 1181191 | 23 LI 24 |] . Thus, their secure and resilient control is 
essential. In this section, we first present three main types of 
adversarial attacks to the mobile network including the global 
positioning system (GPS) spoohng attack, targeted jamming 
attack and denial-of-service (DoS) attack, and then analyze 
their impacts on the network performance. 
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A. GPS Spoofing Attack 

A GPS spoofing attack aims to deceive a GPS receiver in 
terms of the object’s position, velocity and time by generating 
counterfeit GPS signals | 25 ]. In (| 3 l, the authors have demon¬ 
strated that UAVs can be controlled by the attackers and go 
to a wrong position through the GPS spoohng attack. In our 
MRN, we consider the scenario that the physical movement 
of a robot is constrained due to the attacks which can be 
realized by adding a disruptive position signal to the robot’s 
real control command. Therefore, through the GPS spoohng 
attack, the mobile robot cannot move but still maintains its 
communications with other robots in the network. In addition, 
we assume that the attack cannot last forever but for a period of 
Pa in the discrete time measure which is reasonable, since the 
resource of an attacker is limited, and the abnormal/unexpected 
behavior of the other unattacked robots resulting from the 
spoohng attack can be detected by the network administrator. 

In the MRN, if robot i is compromised by the spoohng 
attacker at time step ki, and the attack lasts for ga time steps, 
then this scenario can be cajttured by adding the following 
constraint to the problems and Q2' 


into the mobile robotic networks model, we add the following 
constraint to the Laplacian matrix: 

Wy(fc) = 0 , k = k 2 ,...,k 2 + gb-l, ( 20 ) 

where {i,j) denotes the attacked link, and ^2 is the starting 
point of the attack. 

Attackers are often rational, i.e., they intentionally attack 
those communication links that whose removal will lead to the 
most decrease of the network connectivity. To characterize the 
worst-case of targeted jamming attack, we have the following 
analysis. When link (f,j) is attacked, the resulting Laplacian 
is given by (fTOl l. Denote the Fiedler vector of L as u, and thus 
u^Lu = A2(L) based on the dehnition. By using (I?]), we can 
obtain the following: 

A2(L(f,j)) < u^L(f,j)u 

= u^(L - (ci - Cj) (cij - Cj,,) )u ^21) 

= u^Lu — {ui — Uj){wijUi — WjiUj) 

= A 2 (L) - Wij{u^ - Ujf'. 


Xi{k + 1) = Xi{k), k = ki, ...,ki + ga — 1. ( 17 ) Therefore, by removing the link where 


The attacked robot is usually randomly chosen. To evaluate 
the impact of the attack, we choose the robot that has the 
maximum degree which is denoted by imax- Then, we obtain 

imax e arg max Wij, 

j£Ni 

where Ni is the set of nodes that are connected to node i. 


B. Targeted Jamming Attack 

In wireless communication networks, one class of adver¬ 
sarial event is the jamming attack which can be launched by 
the attackers through injecting a huge amount of false data 
into the communication links ISlllOl]. In this attack scenario, 
we consider the targeted jamming attack which means that 
the attacker jams a certain wireless communication channel 
between mobile robots which leads to a consequence of link 
removal in the network. 

To model this attack, denote the network as G{i,j) = 
{V,E \ {i,j)) removing a link {i,j) S E from network 
G, then, we have L = L — AL and AL = AD — AA, where 
AD and AA are the decreased degree and adjacency matrices, 
respectively. By using equation O, we obtain AD and AA as 
follows: 


AD = -h 
AA = deji 


( 18 ) 


where and j are zero vectors except the f-th element 
equaling to 1 and Wij, respectively, and similar for and 
Denote the Laplacian matrix of G{i,j) as and by 

using equations in (fTST l, we have 


—L (ci ■ ( 19 ) 


Similar to the GPS spoohng attack, the targeted jamming 
attack lasts for gi, time steps. In order to incorporate this attack 


(i, j)* e arg max Wij{ui - Ujf, (22) 

the upper bound for A2(L(z,j)) is the smallest, and the 
algebraic connectivity of G decreases the most. 


C. DeniaTof-Service Attack 

In addition to the targeted link removal attack, another 
attack scenario corresponding to the wireless communications 
is the DoS attack 12611 . The DoS attack can be realized by a 
number of technical methods including Wormhole, Blackhole 
and Grayhole attacks lE^ . Specihcally, in the MRN, the 
malicious attacker generates false message to Hood the robots’ 
communication resources which result in the node removal of 
the network. When a node f € F is removed from the network 
G, then all links that are connected to node i should also be 
removed. Denote the Laplacian matrix of the network after the 
attack as L(i), and remind that Ni is the set of nodes that are 
connected to node i. Then, similar to the analysis of the link 
removal, we have 

L(f) = L - ^ (ci - Cj) {fiij — Ij^i) . ( 23 ) 

j&Ni 

If robot i is attacked at time fca, and the attack lasts for pc time 
steps, then, the following constraint is added to the Laplacian 
matrix: 


Wij{k) = Q, Vj G 14 U V" 2 , fc =/c 3 , ...,^ 3 -l-pc - 1 - ( 24 ) 

In addition, the worst-case of denial-of-service attack can be 
captured as follows. When robot i is attacked, the Laplacian 
of G is changed to (l 2 Tt . Similar to the analysis of the most 
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severe link removal attack, we obtain the following: 

A2(L(7)) < u'^L(7)u 

= - I] (e^ - e,) (e,., - e,.,)^)u 

j&Ni 

= u"^Lu — {ui — Uj)(wijUi — WjiUj) 

j&Ni 

= A2(L) - w^j{ui - Ujf. 

j&Ni 

Hence, by attacking robot i*, where 

i* € arg max > Wij{ui — ( 26 ) 

j£Ni 

the algebraic connectivity of G encounters the most decrease. 

Remark 5 : Depending on the scope of knowledge that the 
attacker has of the network, our proposed game framework 
can be used for attackers of different knowledge levels. For 
example, an attacker may know the information of the whole 
multi-level network or merely one sub-network. For the for¬ 
mer case of attack, closed form solutions have already been 
presented above. The analysis for the latter case can be done 
in a similar way by focusing on a smaller network space. 

VII. Case Studies 

In this section, we validate the obtained results via case 
studies. Specifically, we first show the performance of the 
two-level MRN by using the iterative algorithm. Then, we 
further quantify the impact of malicious attacks introduced in 
Section |Vll and assess the resiliency and interdependency of 
the network to malicious attacks. 


A. Effectiveness of the Algorithm 

In the case studies, both networks Gi and G2 include 6 
mobile robots, and the minimum distance is set to 0 . 4 . The 
link strength parameters of inter-links in two networks are the 
same, i.e., pi = 1 , p2 = 3 and a — 5, and for intra-links, 
the parameters are equal to pi = 1 . 5 , p2 = 5 and a = 4 . 
Without loss of generality. Pi and P2 have the same update 
frequency and they reconfigure their robotic networks in an 
alternating fashion. In addition, YALMIP is adopted to solve 
the corresponding SDP problems 11281 ] . The obtained results 
of the MRN configuration trajectory without attack and its 
corresponding network algebraic connectivity are shown in 
Fig. | 2 (a)| and Fig. | 2 (b)| respectively. In specific, the MRN 
attains an equilibrium state after 10 updates which validates 
the effectiveness of the iterative algorithm. 


B. Impact of Malicious Attacks 

In this section, we quantify the impact of each worst-case 
attack introduced in Section |VT] on the network performance. 
For clarity, we assume that each attack is launched at step 
6 during the network formation game, and without loss of 
generality, all attacks last for two steps. The result of network 
algebraic connectivity under each attack condition is shown 
in Fig. | 3 (a)| We can see that the denial-of-service attack leads 
to the most decrease of the network connectivity comparing 
with other attacks, while the GPS spoofing attack is the least 
severe one. 




(b) 


Fig. 2. (a) Configuration of a two-layer MRN without attack, (b) The 

resulting algebraic connectivity of the network formation game without attack. 




(a) (b) 

Fig. 3. (a) The impact of each worst-case attack on the network connectivity, 
(b) The algebraic connectivity of the network formation game without attack 
and under each attack condition. Under the adversarial environment, the worst- 
case attack happens at step 10, and it remains the same afterwards. 


C. Resiliency of the Network to Attacks 

After obtaining the impact of attacks on the network alge¬ 
braic connectivity, the next step is to quantify the resiliency 
of the MRN to attacks. In specific, the resiliency metric is 
based on the system recovery speed and the recovery ability 
under the adversarial attacks. The adopted MRN model is 
the same as that in Section IVII-Al In addition, we assume 
that the attacks are added to the MRN at step 10 , and the 
attacker’s action remains the same in the following steps. Fig. 
| 3 (b)| shows the corresponding results. Specifically, the GPS 
spoofing attack does not impact the network performance in 
this case, since the attack is added at the point where MRN is 
of an equilibrium configuration, and the constrained physical 
movement of robots is not sufficient to decrease the network 
connectivity. For other cases, we can see that the MRN begins 
to recover after the attack happens which shows the high-level 
situational awareness of the MRN. Moreover, besides the GPS 
spoofing attack, the MRN is the most resilient to the targeted 
jamming attack by using the designed iterative algorithm in 
terms of the agile recovery to a satisfying performance. The 
DoS attack can cause a huge loss of the algebraic connectivity, 
and the MRN cannot fully recover under this attack due to the 
removal of a robot. However, the rate of the network reaching 
a new NE is fast in this case. 


D. Interdependency of Multi-level Robotic Networks 

Comparing with single-level networks, a unique feature of 
the multi-level networks is their inherent interdependencies. 
We aim to show the existence of interdependency in the multi¬ 
level MRN in this section. Fig. 0] depicts the evolution of 
































Fig. 4. MRN configuration under the DoS attack. The attack is introduced 
at step 10 where the initial network formation game reaches an equilibrium. 
Both mobile networks will respond to the DoS attack in the following update 
steps until reaching another equilibrium. 

mobile network configuration corresponding to the DoS attack 
scenario in Section IVII-CI Remind that the attack happens 
at time step 10 where the network is under an equilibrium 
state. After introducing the attack, the two levels of robots 
will respond to it by moving to a new position, validating 
the resiliency of MRN. In addition, by comparing two robotic 
networks in Fig. |2(a)| and Fig. |4] we find that robots in the 
network without attack (upper level) will move toward a posi¬ 
tion that can allow to set up the most intra-links with robots in 
the attacked network (lower level), and this fact cotToborates 
the natural interdependency between two networks. Due to 
the interdependency, the whole mobile network can be more 
resilient to malicious attacks. 

VIII. Conclusion 

In this paper, we have investigated the connectivity control 
of multi-level mobile robotic networks. We have developed 
a decentralized resilient algorithm to maximize the algebraic 
connectivity of the network to adversarial attacks, and shown 
its asymptotic convergence to a Nash equilibrium. Three types 
of attack models have been introduced, and their impacts 
have been quantified. Moreover, case studies have shown 
that the GPS spoofing attack has the least impact on the 
network performance, and the robotic network is the most 
resilient to the targeted jamming attack than other attacks 
by using the proposed control method. Future work can be 
designing a model predictive control algorithm that enables 
robots connectivity-aware during the network formation game. 
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